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if^ fhR naims: 




(a) 
(b) 
(c) 
(d) 



f Pii^fflntl y amended^ A method of enabling user inleraction/^th computa software 

running in a computer system via; 

an interface surface containing information relating t/the computer software and 
jpoluding haying_coded data indicative of a drawing field^^^§ESafid_ffi_SLm*e mtCTfecg 
surface : and 

a sensing device which, when placed in te^ operative position relative to the 
interface surface, senses *t some nf the coded data and eeneratgiL.indicating data 
indicative of the drawing fialri iL«Hn p at least someA the sensed coded data, and generates 
movement data indicative of the sensing device's Movement relative to the interface surface; 
the method including the steps of, in the computer system: 
receiving the indicating data from the* sensing device; 
receiving the movem^t data from me setising device; 
identifying the drawing field fron/the indicating data; and 

operating the computer softwMb at least parfly in rdiance on the movement data, 
and in accordance with instructions associated with the drawing field. 

2. (Original) A method accordlag to claim 1, the method fiirther inchiding the steps 
of, in tiie computer system, assodatog the movement data wifli the drawing field. 

3. (Original) A method a(^iding to claim 1, including the step of sending, in the 
computer system, data to the oot^mter software indicative of at least the drawing field. 

4. (Original) A method According to claim 2, wherein the drawing field is associated 
with a visible drawing zone defined on the interface surface. 

5. (Original) A metluii according to claim 1 , wherein the coded data includes at least 
one tag, each tag being indicative of the drawing field. 

6. (Original) A mfethod according to claim 5, wherein the tags are also indicative of 
points within the drawing field. 

7. (Original) A/method according to claim 6, wherein each of the tags includes: 
first idaitiiy data defining a relative position of ±at tag; and 

second idtentity data identifying the drawing field. 

8. (Origiii^) A method according to claun 7, wherein ttxe relative position is defined 
in relation to the drawing field. 

9. f Chi f/entlv amended") A method of enabling user interaction with computer software 
running in a computer system via: 

interface surface containing infonnation relating to the computer software and 
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f-having_ood©d data indicative of an identity of the intarfece surfaccydispo^ed ^i. 
oq the inl:^ace surface : and 

a sensing device which, when placed in an operative positkto relative to the 
interface surface, sense s at least some of t he coded data and gcnytes indicating data 
indicative of the id«itity of the interface surface^ and generates mov^ent data indicative of 
the sensing device's movement relative to the interfece surface; 
the method including the steps of, in tfie computer sys 

(a) receiving the indicating data from the sensing device; 

(b) receiving the movement data from the sensing devi 

(c) performing written gesture recognition in relation lb at least some of the movement 
data; and 

(d) in the event that a written gesture is recognisea, operatiixg the computer system m 
accordance with instructions associated with the writte&x gesture and the interface surfece, 
10. (Original) A method according to claim 9( wherein the selection gesture includes 
circumscribing or underlining at least some of the infontiation. 

IL (Original) A method according to anyone of the preceding claims, wherein the 
sensing device includes at least one acc^eration measuring device for measuring 
acceleration of the sensing device as it is us/d to draw the hand-drawn user input onto the 
surface, the movement data being generated by periodically sampling the acceleration of the 
sensing device as it is used to draw the haiid-drawn user input onto the surfece. 

12. (Original) A method according/to claim 1 1 , fiirther including the step of generating 
movement data in the form of a locu/ of the sensing device in relation to the surface, the 
locus being detennined by ascertaining relative displacement of the sensing device. 

13. (Original) A method acco^ing to claim 12, wh«ein the relative displacement is 
obtained by doubly integrating tiheyacoeleration with respect to time* 

14. (Original) A method According to claim 12 or 13, wherein the acceleiation 
measuring device includes one/or more accelerometers configured to measure at least two 
orthogonal components of acceleration. 

15. (Original) A methdd according to any one of claims 1 to 10. wh^ein position 
elements are disposed on/the interface surface, the sensing device being configured to 
periodically sense position elements as it is used to draw the hand-drawn user input onto the 
surface, the method induding the step of generating Ae movement data in the form of a 
locus of the sensing dJice in relation to the surface by ascertaining relative displacement of 
the sensing device over time with respect to at least one of the position elements. 

16. (Original) A method according to daim 15, wherein the position elements are 
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disposed on the turface as a regular array of dots, lines or other fonnaliona( 

17. (Original) A method according to claim 15, wherein the position elements are 
disposed on the sur&ce stochastically. / 

18. (Previously amended) A method according to any one of jClaims 1 to 10, wherein 
the movement data is generated by ascertaining relative movemrat of one or more motion 
sensing elements rotatably mounted to the sensing device for coiltact with the surface while 
the sensing device is used to dmw the hand-drawn user input th^-con. 

19. (Original) A method according to claim 18, wher^ the motion sensing elements 
include one or more roUerballs mounted for rotation within/a constraining housing disposed 
substantially within the sensing device. / 

20. (Originfll) A method according to claim 19, Werein components of rotation of the 
roUerball, due to movement of the sensing device wh^ drawing the hand-drawn user input 
onto the surfece, are periodically measured, / 

21. (Original) A metlKKi aocoiding to claim 20, wherein the components of rotation of 
the rollerball due to movement of the sensing device by the user when drawing the hand- 
drawn user input onto the surface are measxiredby means of: 

rollers disposed within the constcaining housing for rotation^ the rollers being 
configured to be driven by contact with therotating roUetball; or 

optical sensing of rotation of th/roUerball with respect to the constraining housing, 

22. (Original) A method according to claim 7, wherein the relative position is defined 
in relation to a plurality of the other tags. 

23. (Original) A method acc^iing to claim 7, wherein the relative position is defined 
in relation to the interface surface: 

24. (Original) A method atcording to claim 7, wherein the first identity data identifies 
stored information defining tne relative position, the stored infogcuxation not being stored on 
the interface surEace. / 

25. (Original) A method according to claim 24, wherein the first identity data and the 
second identity data togomer identify stored information defining the relative position. 

26. (Original) A method according to claim 9, wherein the coded data includes at least 
one tag, each tag bei^ indicative of the drawing field 

27. (Original) A method according to claim 26, wherein the tags are also indicative of 
points of the inter&ce surface. 

28. (Originril) A method according to claim 27, wherein each of the tags includes: 
first idfentity data defining a relative position of that tag; and 
second identity data identifying the interface sur&ce. 
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29. (Currently amended'^ A system for enabling user interaction with compu^ software 
running in a comptitcr system via: / 

an interface surface containing information relating to the computer software and 
includinp -havins coded data indicative of a drawing fiel d disposed in jor on the interface 
surface ; and / 

a sensing device which, when placed in an operative iwjsition relative to the 
interface surface, senses at least some of the coded data and/generates i ndicating data 
indicative of the drawing fiel d using at least some of the sensed coded data, and generates 
movement data indicative of the sensing device's movenient/clative to the interface surface; 
the computa: system being configured to: / 

(a) receive the indicating data fixnn the sensing deylce; 

(b) receive the movement data £bom the sensine4evice; 

(c) identify the drawing field from the indicati&g data; and 

(d) operate the computer software at least pjicQy in reliance on the movement data, and 
in accordatxce with instructions associated witlyttie drawing field* 

30. (Origixxal) A system according to yClaim 29, the computer system further being 
configured to associate the movement datawith the drawing field. 

31. (Original) A system according to claim 29, the computer system being configured 
to send data to the computer software imicative of at least the drawing field. 

32. (Original) A system according to claim 30, wherein the drawing field is associated 
with a visible drawing zone defined/on the interface surface. 

33. (Original) A system accwding to claim 29, wherein the coded data includes at least 
one tag, each tag being indicative of the drawing field. 

34. (Original) A system According to claim 33, wherein the tags are also indicative of 
points within the drawing fiefld. 

35. (Original) A systpn according to claim 34, wherein each of the tags includes: 
first identity da^ defining a relative position of that tag; and 
second identity data identifying the drawing field. 

36. (Original) A system according to claim 35, wherein the relative position is defined 
in relation to the ^wing field. 

37- (Cimentlv amended") A system of enabling user interaction with computer software 
running in a computer system via: 

an interface surface containing infonnation relating to the computer software and 
including h flNdas.coded data indicative of an identity of the interfece surface disposed in or 
on the intAfacc surface: and 
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a sensing device wbidi, when placed in an operative position relative to the 
interfece surface, senses at least some of the co ded data and generates indicating data 
indicative of the identity of the interface gurfacejiaiiig at least some of theT sensed coded 
data, and generates movenient data indicative of the sensing device's mov^ent relative to 
the ixxterface sur&ce; 

the computer system being configured to: 

(a) receive the indicating data from the sensing device; 

(b) receive the movement data from ±e sensing device; 

(c) perform written gesture reoogcdtion in relation to at Icast^some of the movement 
data; and 

(d) in the event that a written gesture is recognised, operate the computer software in 
accordance with instructions associated with the written gestiHe and the interface surfece, 
38. (Previously amended) A system according to cdaim 37, wherein the written 
gesture includes circumscribing or underlining at least some of the infonnation. 

j * 39, (Original) A system according to any one of cmms 29 to 38, wherein the sensing 

device includes at least one acceleration measuring demcQ for meas^^ring acceleration of the 
sensing device as it is used to draw the hand-dmwn user input onto the surface, tiie 
movement data being generated by periodically sampling the acceleration of the sensing 
device as it is used to draw the hand-drawn user imut onto the surfacc. 

40. (Currently amended) A system accord^ to claim 39, wherein the computer system 
is configured to generating the m ovement data in the form of a locus of the sensing device 
in relation to the surface, the locus being determined by ascertaining relative displacement of 
tiie sensing device. ^ 

41. (Original) A system according to claim 40, wherein the relative displacement is 
obtained by doubly integrating the acceleration with respect to time. 

42. (Original) A system according to claim 40 or 41, wherein the acceleration 
measuring device includes one or more accelerometers configured to measure at least two 
orthogonal components of acceleratioiL 

43. (Previously Amended) A system according to any one of claims 29 to 42, wherein 
position elemmts are disposed on /the interface surfiace, the sensing device being configured 
to periodically sense position elements as it is used to draw the hand-drawn user input onto 
the surfiice, the computer system being configured to generate the movement data in the 
form of a locus of the sensing device in relation to the surface by ascertaining relative 
displacement of the sensing device over time with respect to at least one of tiie position 
elements. 
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44. (Origmal) A system according to claim 43, whereiii the positi^ elements are 
disposed on the smfece as a regular anay of dots, lines or other formations 

45. (Original) A system according to claim 43, wherein the p^ition elements are 
disposed on the surfiice stochastically. 

46. (Original) A system according to any one of daims ^9 to 45. wherein the 
movement data is generated by ascertaining relative movcmm/ of one or more motion 
sensing elements rotatably mounted to the sensing device for c/ntact with the surface wWle 
the sensing device is used to draw the hand-drawn user input thereon. 

47. (Original) A system according to claim 46, wher^ the motion sensing elements 
include one or more roUerballs mounted for rotation with;4 a constraining housing disposed 
substantially within the sensing device. 

48. (Original) A system according to claim 47, j/herein components of rotation of the 
roUerball, due to movement of the sensing device ^en drawing the hand-drawn user input 
onto the surface, are periodically measured. 

49. (Original) A system according to claim i8, wherein the components of rotation of 
the foUerball due to movement of the sensing device by the user when drawing the hand- 

I drawn user input onto the surfece are measure|l by means of: 

! rollers disposed within the constoUing housing for rotation, the rollers being 

1 configured to be driven by contact with the^otating roUerball; or 

I optical sensing of rotation of thyrolleiball with respect to the constraining housing. 

! 50. (Original) A system accordin/to claim 35, wherein the relative position is defined 

! in relation to a plurality of the other 1 

! 51 . (Original) A system accoi^g to daim 35, wherein the relative position is defined 

I in relation to flie interfece surface. 

I 52. (Original) A system ac«4ding to claim 35. wherein the first identity data identifies 

I stored information defining theytelative position, thfi stored information not being stored on 

• the interface surface. 

I 53. (Original) A system'^according to claim 52. wherein the first identity data and the 

\ second identity data togeth^ identify stored information defining Ae relative position. 

! 54. (Original) A syst4i according to claim 37, wherein the coded data includes at least 

I one tag, each tag being jjbidicative of the interfece surfece. 

' 55. (Original) A intern according to claim 54, wherein the tags arc also indicative of 

j points on the interfac^ surface. 

I 56. (OriginalVA system according to claim 55, wherein each ofthe tags includes: 
I first ido^ty data defining a relative position of that tag; and 
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second identity data identifying the drawing field. 

57. (Currentlv A mended) A method to enable a usct to intoract witii computer software 
running in a computer system utilizing a form printed onto a sxirfaoe, ttie form including 
infomiation relating to the computer software^ the stirface having cotfed data indicative of a 
drawing field relating to ttie computer softwar e disposed in or on/the surface, the method 
including the steps of; 

providing the ft>rm to the usct; 

receiving, in the computer system, indicating data ohd movement data fiom a 
sensing device, the indicating data indicative of the drawinfg field, the movement data 
indicative of movement of the sensing device relative to the form, the sensing device, when 
placed operatively relative to the drawing field, generating me indicating data based at least 
partially on sensing at least some of the coded data /and substantially simultaneously 
generating the movement data; and 

identifying* in the computer system and fitmiyflie indicating data, the drawing field, 

and 

operating the compute software at least partially in reliance on the movement data 
and on instructions associated with the drawix]^ field. 

58. (Previouls added) The method of claim 57, which includes printing the fonn in 
response to receiving, in the computer system^A request for the form. 

59. (Previously added) The method of >claim 57, which includes causing the form and 
the coded data to be printed onto the surface substantially simultaneously. 

60. (Previously added) The method of claim 57 fiirther including, in the computer 
system, associating the movement data Aith the drawing field. 

61. (Previously added) The meflxod of claim 57, including the step of performing 
written gesture recognition on at least some of the movem^t data. 

62. (Previously added) The ^method of claim 57 fiirth^ including the step of, in the 
computer system, recognizing whether the movement data is indicative of a written gesture 
drawn on the sur&ce by the use 

63. (Previously added) The method of claim 61 wherein, in the event that the written 
gesture is recognized, operating the computer system in accordance with instructions 
associated with the written^esture. 

64. (Previoxisly added) The method of claim 62 wherein the written gesture includes a 
selection gesture. 

65. (Previously a^ded) The method of claim 61 wherein the selection gesture includes 
circumscribing or underlining at least some of the information. 
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66. (Previously added) The method of claim 57, including the step of identifying the 

user. / 

67. (Previously added) The method of claim 66. wherein the step of identiwing the user 

includes using the movement data. / 

68. (Previously added) The method of claim 66, further including the s^ of receiving* 
in the computer system, data indicative of an identity of the user. / 

69. (Previously added) The method of claim 57, further including the step of receiving, 
in the computer system, data from a memory of the sensing device, the/flata being indicative 
of an identity of the user* / 

70. (Previously added) The method of claim 57, including ibd step of sending, in ihe 
computer system, data to the computer software indicative of at l^t the drawing field* 

71 . (Previously added) The method of claim 57, wherein the drawing field is associated 
with a visible drawing zone defined on the sxirfece. / 

72. (Previously added) The method of claim 57, wherem the sensing device includes at 
least one acceleration measuring device for measuring acceleration of the sensing device as 
it is used on the surface, the movement data being geneAted by periodically sampling the 
acceleration of the sensing device as it is used on the surface. 

73. (Previously added) The method of claim 57, ftfrther including the step of generating 
movement data in the form of a locus of the sensing device in relation to the surface, the 
locus being detemiined by ascertaining relative displacement of the sensing device. 

74. (Previously added) The method of claim/73, wherein the relative displacement is 
obtained by doubly integrating the acceleration with respect to time. 

75. (Previously added) The method of claim 72, wherein the acceleration measuring 
device includes one or more accelerometers cpnfigured to measure at least two orthogonal 
components of acceleration. / 

76. (Previoudy added) The method ofyfclaim 57, wherein elements are disposed on the 
surface, the sensing device being configuixW to periodically sense the elements as it is used 
on the surface, the method including /the step of generating the movement data by 
ascertaining relative displacement of the/sensing means over time with respect to at least one 
of the elements. / 

77. (Previously added) The method of claim 76^ wherein the elements are disposed on 
the surface as a regular array of dotsylines or other fomiations. 

78. (Previously added) The method of claim 76, wherein the elements are disposed on 
the surface stochastically. / 

79. (Previously added) Thef method according to claim 76, wherein the coded data 
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includes the elements. 

80. (Previously added) The method of claim 57, wherein the movement data is 
generated by ascertaining relative rotation of one or more motion sensing elements rotatably 
moxinted to the sensing device for contact with the surface while the sensing'^device is used 
thereon. / 

81. (Previously added) The method of claim 80 wherein the motioxi sensing elements 
include one or more rolleiballs mounted for rotation within a constraimng housitxg disposed 
substantially within the sensing device. / 

82. (Previously added) The method of claim 81, wherein components of rotation of the 
rollerball, due to movement of the sensing device on the surface, afe periodically measured. 

83. (Previously added) The mediod of claim 82, wherein me components of rotation of 
the roUerball due to movement of the sensing device on the aurfece are measured by means 
of: / 

rollers disposed within the constraimng housing for roation, the roUors being configured to 
be driven by contact with the rotating roUerball; or / 

optical sensing of rotation of the roUerball with respect the constraining housing. 

84. (Previously added) The method of claim 57, wherein the coded data is indicative of 
a plurality of positions, in or associated with the drawing field. 

85. (Previously added) The method of claim 57, wherein the coded data includes a 
plurality of tags, each of which includes tag data,/ 

86. (Previously added) The method of claito 85, including deriving the relative position 
of at least one tag using at least some of the at^east one tag's tag data. 

87. (Previously added) The method of^laim 86, wherein the relative position is defined 
in relation to one of the group comprising/ a plurality of other tags, the surface, the drawing 
field and a zone associated with the drawing field. 

88. (Previously added) The meth)ZW of claim 85, including deriving an identity of the 
drawing field using at least some of me tag data of at least one tag. 

89. (Previously added) The method of claim 88, wherein the data fi-om which the 
identity of the drawing field is derived is the same in all tags of the same drawing field. 

90. (Currently amended^ A system for enabling a user to interact with computer 
software running in a compiler system utilizing a form printed onto a surface, the form 
including information relatmg to the computer software, the surface having coded data 
indicative of a drawing fieM relating to the computer softwar e disposed in or on tfie ffurface, 
the system including; / 

a computer systeiiHwhich: 
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receives indicating data and movement data fixjm a sensing device, the indicatii^g 
data indicative of a drawing field relating to the computer software and the movement data 
indicative of movement of the sensing device relative to the form, the sensing device, wh^i 
placed operatively relative to the drawing field, generating the indicating data based at least 
partially on sensing at least some of the coded data and substantially simultaneously 
generating the movement data; 

identifies, fiom the indicating data, the dmwing field, and 

operates the computer software at least partially based on reliance on the movement 
data and instructions associated with the drawing field. 

9 1 . (Previously added) The system of claim 90 including a i^ter for printing the form 
in response to receiving, in the computer system, a request for flfe fomi. 

92. (Previously added) The system of claim 90 including a printer for printing the form 
and in which the printer prints the coded data at substantially the same time aa the fomi, 

93. (Previously added) The system of claim 90 therein the computer system is 
configured to associate the movement data with the drawng field. 

94. (Previously added) The system of claim 90, wherein the computer system is 
configured to perform written gesture recognition on^t least some of the movement data. 

95. (Previously added) The system of claito 90 wherein the computer system is 
configured to recognize whether the movement jiata is indicative of a written gesture drawn 
on the surface by the user. 

96. (Previously added) The system of claim 94 wherein the computer system is 
configured, in the event that the written /gesture is recognized, to operate the computer 
software in accordance with instructions associated with the written gesture. 

97. (Previously added) The systeigr of daim 95 wherein the written gesture includes a 
selection gesture. 

98. (Previously added) The sys^ of claim 97 wherein the selection gesture includes 
circumscribing or underlining at leafet some of the information. 

99. (Previously added) Th^ system of claim 90, wherein the computer system is 
configured to identify the user. 

100. (Previously added) ^e system of claim 99, wherein the computer system is 
configured to identify the tisp by using the movement data- 

101. (Previoiisly added) The system of claim 99, wherein the computer system is 
configured to receive dat^indicative of an identity of the user. 

102. (Previously added) The system of claim 90, wherein the computer system is 
configured to receive identity data fix)m a memory of the sensing device, the identity data 
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being indicative of an ideatity of the user. 

103. (Previously added) The system of claim 90, wherein the computet system is 
configured to send data to the computer software indicative of at least the drawing field, 

104. (Previously added) The system of claim 90, wherein the drawing ^Id is associated 
with a visible drawing zone defined on the surface, 

1 05. (Previously added) The system of claim 90 which includes the sensing device. 

1 06. (Previously added) The system of claim 1 05, wherein the scnsmg device includes at 
least one acceleration measuring device for measuring acceleration (/f the sensing device as 
it is used on the surface, the movement data being generated by periodically sampling the 
acceleration of the sensing device as it is used on the surface. 

107. (Previously added) The system of claim 105, wherein/the sensing device generates 
movement data in the form of a locus of the sensing meajy io relation to the surface, the 
locus being detennined by ascertaining relative displacemeirt of the sensing device. 

108. (Previously added) The system of daim 107, wjherein the relative displacement is 
obtained by doubly integrating acceleration with respect^to time. 

109. (Previously added) The system of claim 10^, wherein the acceleration measuring 
device includes one or more aocelerom^ers confi^ired to measure at least two orthogonal 
components of acceleration. 

110. (Previously added) The system of claim 105, wherein elements are disposed on the 
surface, the sensing device being configured to periodically sense elements as it is used on 
the surface, the movement data being generated by ascertaining relative displacement of the 
sensing means over tune with respect to at /east one of the elements. 

111. (Previously added) The system pf daim 110. wherein the dements are disposed on 
the surfece as a regular array of dots, liries or other formations. 

1 12. (Previously added) The syst^ of claim 110, wherein the elements are disposed on 
the sux&ce stodiastically. 

113. (Previoiisly added) The /ystem of claim 110 wherein the coded data inclxides the 
elements^ 

114. (Previously added) Ae system of claim 105, wherein the movement data is 
generated by ascertaining relative movement of one or more motion sensing elements 
rotatably moimted to the srosing device for contact with the surface while the sensing device 
is used thereon. 

115- (Previously adJied) The system of daim 1 14. wherein the motion sensing dements 
include one or more ^Uerballs mounted for rotation within a constraining housing disposed 
substantially withi/the sensing device. 
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1 16. (Previously added) The system of daim 1 1 5, wherein components of rotation of the 
roll^ball, due to movement of the sensing device when used on the si^ce, are periodically 
measured. 

117. (Previously added) The system of claim 1 16, wherein the/6omponents of rotation of 
the rollerball due to movement of ±e sensing device by the us^ when used on the surface 
are measured by means of: 

rollers disposed within the constraining housing ibr rotation, the rollers being 
configured to be driven by contact with the rotating rollerbatl; or 
optical sensing of rotation of the roUerball with respect to ttie constraining housing. 

118. (Previously amended) The system of claim 90, wherein the coded data is indicative 
of a plurality of positions in or associated with the dravymg field. 

119. (Previously added) The system of claim 9^, wherein the coded data includes a 
plurality of tags^ each of whidi inclxides tag data. 

120. (Previously added) The system of claiiri 119, wherein the computer system is 
configured to derive the relative position of at le^ast one tag using at least some of the tag 
data of the at least one tag. 

121. (Previously added) The system of y^laim 120, wherein the relative position is 
defined in relation to one of the following moup: a plurality of other tags, the surface, the 
drawing field, and a zone associated with the draMong field. 

122. (Previously added) The systemT of claim 118, where the computer system is 
configured to derive an identity of the (Rawing field using at least some of the tag data of at 
least one tag. 

123. (Previously added) The sj^em of claim 122, wherein the data from which the 
identity of the drawing field is deriyfed is the same in all the tags of the same drawing field. 

124. (Previously added) The system of claim 105 wherein the sensing device includes a 
marking nib. 

125. (Previously added) TOe system of claim 105 wherein the sensing device contains 
identity infomiatiotx which iinparts a uniqiie identity to the sensing device. 

126. (Previously addedVThe system of claim 125 when dependOTt on clattn 102, wherein 
the identity data includes the identity of the sensing device. 
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